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[57] ABSTRACT 

A method for tracking an object in a sequence of images 
is described. Such sequence of images may, for example, 
be a sequence of television frames. The object in the 
current frame is correlated with the object in the previ- 
ous frame to obtain the relative location of the object in 
the two frames. An optical joint transform correlator 
apparatus is provided to carry out the process. Such 
joint transform correlator apparatus forms the basis for 
laser eye surgical apparatus where an image of the fun- 
dus of an eyeball is stabilized and forms the basis for the 
correlator apparatus to track the position of the eyeball 
caused by involuntary movement. With knowledge of 
the eyeball position, a surgical laser can be precisely 
pointed toward a position on the retina. 

7 Claims, 3 Drawing Sheets 
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OPTICAL JOINT CORRELATOR FOR REAL-TIME 

IMAGE TRACKING AND RETINAL SURGERY 

ORIGIN OF THE INVENTION 5 

The invention described herein was made by an em- 
ployee of the United States Government and may be 
manufactured and used by or for the Government of the 
United States of American for governmental purposes 
without the payment of any royalties thereon or there- 
for. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 15 

This invention relates generally to optical correla- 
tors, and more particularly to optical correlators for 
real-time tracking of the position of a moving object. 
Still more particularly, the invention relates to a joint 
transform optical correlator for real-time tracking of 20 
the position of an image of the interior of the eye and, 
based upon such tracking directing a surgical laser beam 

to a precise point of the retina as directed by a surgeon. 

2. Description of the Prior Art 

Optical pattern recognition has been suggested in *25 
various applications because of its parallel processing 
and high-speed operation capabilities, particularly in 
real-time applications such as missile guidance, vehicle 
tracking, and automated lander guidance in aerospace 
missions. In 1974, VanderLugt in a paper entitled, “Co- 30 
herent Optical Processing”, Proc. IEEE 64, 1300 
(1974), described the use of matched spatial filters 
(MSFs) in performing cloud motion analysis in a se- 
quence of photographs taken from a satellite in half- 
hour intervals. A new MSF was made for every photo- 35 
graph in order to correlate with the scene in the next 
picture. Obviously such a method is not a practical 
real-time technique. 

With the recent development of various kinds of 
spatial light modulators, several real-time tracking 
methods have been demonstrated. A. D. Gura de- 
scribed a liquid crystal light valve to perform real-time 
tracking based on a fixed MSF in a VanderLugt correla- 
tor in the paper, “Real-time tracking of moving objects 45 
by optical correlation,” Appl Opt. 18,172 (1979). T. H. 
Chao and H. K. Liu described a liquid crystal television 
spatial light modulator, a dichromated gelatin mul- 
tifocus hololens and a MSF array for simultaneously 
tracking multiple objects in their paper, “Real-time 50 
optical holographic tracking of multiple objects,” Appl. 
Opt. 28,266 (1989). 

Optical tracking using novelty filters and image sub- 
traction have been proposed in which the system de- 
tects the difference between sequential image frames 55 
and then computes the position of the object in mo'tion. 
Such proposals are described in the paper by D. Z. 
Anderson, D. M. Lininger, and J. Feinberg, “Optical 
tracking novelty filter,” Opt Lett. 12,123 (1987) and in 
the paper by Y. Li, A. Kostregewski, D. H. Kim, and G. 60 
Eichman, “Liquid crystal T.V.-based white light opti- 
cal tracking novelty filter,” Appl. Opt. 28, 4861 (1989). 

The art of optical pattern recognition described 
above in general requires matched spatial filters that 
require intensive computations and individually span 65 
only a relatively small range of apperances of an object. 

A tracking system based on that technology thus suffers 
from difficulty in adapting to new objects, changes in 
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the inherent appearance of an object, or altered per- 
spective views of an unchanging (but moving) object. 

Other methods used digital computation rather than 
optical filters to perform conversion from one domain 
to another by means of the Fourier transform. Digital 
computation is relatively expensive and complicated as 
compared to optical filtration. Furthermore it suffers 
from some of the same disadvantages as matched optical 
filtration because it has to be “taught” the pattern to be 
recognized on a case by case basis. Such disadvantages 
have prevented rapid adaptation to changes in the pat- 
tern. 

Accordingly, a primary general object of the inven- 
tion is to provide a method for object tracking using a 
joint transform correlator which does not require the 
use of a matched spatial filter in the correlation process. 

Another general object of the invention is to provide 
a joint transform correlator for the tracking of a moving 
object which inherently includes the adaptiveness and 
high processing speed of an optical system. 

A preferred embodiment of the optical joint correla- 
tor for image tracking according to the invention is for 
tracking the movement of the retinal image of an eye 
surgery patient. 

In prior art eye surgery, nystagmic motions of the eye 
reduce the precision of the surgeon’s aim in retinal sur- 
gery such as laser-inducted photocoagulation. An eye 
can be paralyzed against such motions by anesthetic 
injection but with possible damage to the optic nerve. 

Another prior art method to aim the eye surgeon’s 
laser beam is to mount a large contact lens and attached 
mirrors on the eyeball. As the lens moves with the 
eyeball, the mirror corrects the motion of the laser 
beam to compensate for motion of the eyeball. The 
contact lens method for laser beam pointing to a partic- 
ular spot on the retina is cumbersome to use and uncom- 
fortable to the patient. 

Another prior art eye surgery method is use “Pur- 
kinje” images to point a laser beam to a specific spot on 
the retina of an eye. Purkinje images arise from multiple 
reflections among surfaces near the front of the eyeball. 
Such method is indirect in that depends on reflections of 
structures near the front of the eyeball rather than being 
a direct image of the retina. Patients with eye disease 
who require eye surgery frequently also have degrada- 
tion of the very structures which make the Purkinje 
images possible. 

Accordingly, it is another object of the invention to 
provide a non-invasive method and apparatus for ob- 
taining a direct image of and for precisely directing a 
surgeon’s laser beam to a point on the retina of an eye- 
ball. 

Still another object of this invention is to provide a 
method and system for automatically adapting to slow 
changes of appearances from time frame to time frame 
of a tracked object, specifically a retina of an eye, which 
may be altered in its appearance during the progress of 
surgery, which may only be perspectively altered by a 
surgeon by changing the magnification of an optical 
viewing system to suit himself during the surgery. 

SUMMARY 

The objects identified above, as well as other advan- 
tages and features are achieved by the hybrid optical/- 
digital system including a joint transform correlator in 
which an object occurring in a sequence of images is 
tracked. The basic idea of the invention is to provide a 
method and system to correlate the object in the current 
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frame with the object in a previous frame of sequential 
video images so as to obtain the relative positions of the 
object in the two frames. The invention takes advantage 
of the high degree of correlation between successive 
appearances of an object that is changing slowly with 
respect to the video frame rate. 

More particularly, the invention is for a method for 
tracking the location of a moving object which is the 
subject of a time sequence of video images. The image 
of the object is displayed in a current frame in side-by- 
side relation with an image of the object in some prede- 
termined previous frame. Such previous frame may be 
the immediately preceding frame or a previous single 
reference frame which may be changed from time to 
time. Next, the joint display of the images is optically 
Fourier transformed, for example by an optical Fourier 
lens, to produce a joint transform power spectrum of 
the image of the joint display. Then, the inten- 
sity — detected joint transform power spectrum is itself 
encoded and optically Fourier transformed to produce 
a correlation function between the image of the current 
frame and the previous frame. The correlation function 
will include at least one cross-correlation peak or opti- 
cal “bright spot”. The intensity of such peak or spot is 
an indication of the degree of correlation of the object 
in the two images. The location of the object in the 
current frame is determined by updating its location in 
the previous frame with the location of the optical 
bright spot. 

The joint transform correlator may be incorporated 
in a system for aiming a surgical laser at a point on the 
retina of an eye. In this specific embodiment of the 
invention, the retina is continuously viewed by a video 
camera. A frame of video is “grabbed” for subsequent 
use as a positional reference. Thereafter, the reference 
image and the real-time image are presented side-by- 
side in the optical joint correlator described above. A 
gimballed tracking mirror positioned near the eye re- 
flects the image of the retina through a two-way mirror 
to the T.V. camera. A surgeon’s laser beam is directed 
into the eye via the two-way mirror and the gimballed 
mirror. The “grabbed” frame of the retina is presented 
on a surgeon’s T.V. monitor. A track ball or the like 
enables the surgeon to place a cross-hair or cursor or 
the like on the precise spot to which the laser beam is to 
be directed. The gimballed tracking mirror is positioned 
by means of track ball signals and position deviation 
signals from the joint transform correlator to precisely 
direct the laser beam to the spot identified by the sur- 
geon on his monitor. Such correlator deviation signals 
track the fundus of the eye even where the eye moves 
during surgery. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The objects, advantages and features of the invention 55 
will become more apparent by reference to the draw- 
ings which are appended hereto and wherein like nu- 
merals indicate like elements and wherein an illustrative 
embodiment of the invention is shown, of which: 

FIG. 1 is a general schematic of the method and 60 
apparatus of the invention by which the relative posi- 
tion of an object is tracked from frame to frame of video 
images of the object; 

FIG. 2 is a preferred embodiment of the generalized 
joint transform correlator according to the invention; 65 

FIG. 3 is an illustration of the coordinate definition of 
an object in side-by-side display of a previous video 
image and a current video image; and 
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FIG. 4 is a schematic of eye surgery apparatus by 
which a surgeon’s laser beam is precisely directed in 
real-time to a spot on the retina of an eye under control 
of a joint transform correlator even where the patient’s 
eye is moving. 

DETAILED DESCRIPTION OF PREFERRED 
EMBODIMENTS 

General Description of Joint Transform Correlator 

FIG. 1 illustrates the method of the joint transform 
correlator 10 of the invention. A laser 12 produces a 
coherent light beam directed toward spatial light modu- 
lator SLM1 on which images A and B are displayed. 
Image A is an image of an object, for example vehicle V 
as produced by T.V. camera 14 and as frozen by frame 
grabber 18 of computer 16. Image B is an image of the 
same object, that is vehicle V, taken at a later time. Such 
time may, for example, be the next available frame of 
the image of the object under the speed constraints of 
the computer 16 and other processing equipment of the 
system. 

The beam Ii, through the spatial light modulator 
SLM1 is directed along optical path 18 through Fourier 
transform lens FI which optically Fourier transforms 
the joint images to an optical image which is applied via 
optical path 20 to a CCD detector 22. The detected 
pattern of CCD detector 22 is written via electrical 
connector 26 onto spatial light modulator SLM2. The 
pattern of spatial light modulator is illuminated by co- 
herent light beam I 2 from laser 24. The resulting beam 
along path 28 is applied to Fourier transform lens F2 
which optically transforms the beam via path 30 to 
CCD detector 32. One or more bright spots or correla- 
tion peaks 34 appear on the CCD detector 32. The 
displacement of such spot 34 as measured by computer 
36 via electrical connection 38 is representative of the 
amount of movement in x and y of object V from the 
time of frame A to frame B. The brightness or intensity 
of spot 34 is representative of the degree of correlation 
of the object appearing in the image of frame A with 
that in the image of frame B. 

The joint transform correlator 10 may include SLM1 
and SLM2 of the magneto-optic device type manufac- 
tured by Litton-Semetex. Alternatively, SLM1 and 
SLM2 may be deformable mirror devices manufactured 
by Texas Instruments. CCD Detectors 22 and 32 may 
be conventional CCD detectors. Fourier transform 
lenses FI and F2 are conventional lens and computers 
16 and 36 may be conventional micro-computers. 

As indicated above, the side-by-side images presented 
to electrically addressed spatial light modulator SLM of 
FIG. 1 may be an electronic video signal. The image in 
the video signal may be time varying. The SLM needs 
to be addressable at a sufficiently high speed to resolve 
the movement of the object in the image. The address- 
ing of the SLM may be optical, in which case a live 
optical image is presented to one half of the SLM and a 
static optical image is presented to the other half. Alter- 
natively, if the SLM is electrically addressed, then the 
source of the electrical image (ordinary a CCD camera) 
must also have a sufficiently high speed to resolve the 
movement of the object in the image. SLM’s have dif- 
ferent speeds at which they can be addressed. The liquid 
crystal display of some TV’s is limited to approximately 
30 Hz, but ferroelectric liquid crystal material may be 
addressed at speeds up to tens of KHz. 
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Tracking by correlating a frame to a temporally im- 
mediately adjacent frame may be expected to produce 
the most precise results, as such pairs of images most 
closely resemble each other and the correlation spots 
will be most clearly defined. However, in that system, 5 
any measurement bias in determining the location of the 
correlation spot adds linearly with the number of corre- 
lated frames. The tracking will drift linearly in time 
with a speed given by the single-measurement bias di- 
vided by the frame rate. Such drift rate can be reduced io 
by maintaining one master frame as the reference as 
long as it continues to produce a useable correlation 
with the tracked object. In that case the bias-induced 
drift rate is reduced by a factor equal to the number of 
frames for which the same master reference frame is 15 
used. 
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light field at the output plane at camera lens 112 be- 
comes, 

C(x,y) F~n\7\u,v)\ 2 } 

- Rtj (xy) + Rt-u-i (xy) + 

R t ,t - 1 (x + 8x,y 4 - 6y - a) + 

Rt-U (x - 8x,y - 8y + a) 

where 

Rm,n (*,y) = F-‘ {F m (.u,v)F n *(u.v)} 

/* 00 r~ 00 

= / J fm («.v) fn*(u ~ X v - y)dudv 


Preferred Embodiment of Joint Transform Correlator 

The joint transform correlator 100 of FIG. 2 is a 
preferred embodiment of correlator 10 of FIG. 1. In this 20 
embodiment, a single spatial light modulator LCTV is 
used in combination with T.V. camera 14 in a feedback 
architecture. In this preferred embodiment a Seiko 
color LCTV model LVD 202, 220x240 pixels, is used 
with the diffuser and protective glass removed. The 25 
liquid crystal display of the commercial LCTV 102 is 
first removed. To compensate for the phase distortion, 
the liquid crystal display is then separated from the 
hardware circuit box and immersed in a liquid gate 
filled with mineral oil. The two original polarizers at- 30 
tached to the display unit are left untouched. A half- 
wave plate 104 is inserted in front of a He-Ne laser 106 
to align the plane of polarization of the linear polarized 
light with the LCTV 102 front polarizer. These modifi- 
cations are made to the Seiko LCTV model LVD 202 35 
to obtain maximum transmission and a high constant 
ratio. 

Two sequential scenes A and B of a moving object V 
are displayed on the LCTV 102 via a frame grabber of 
computer 108 and TV camera 14. The scenes A and B ^ 
are illustrated as positioned in the upper and lower half 
of the LCD of LCTV 102, but of course, they may be 
displayed side-by-side, that is, to the right and left of 
each other. 

The image function as illustrated in FIG. 3 illustrate 45 
that the object of the previous frame has moved an 
amount Delta x and Delta y in the current frame. Math- 
ematically the image functions of the objects displayed 
on the LCD of LCTV 102 are 


is the correlation function between f m and f„, F _1 {*} 
denotes the inverse Fourier transform of the function 
{*}. The first two terms of the C(x,y) function above 
represent the zero-order terms diffracted around the 
origin of the output plane. The last two terms represent 
the cross-correlation terms diffracted at 

Xpeakl = 5x, y pea k l = (8y - a); 

Xpeak2 = §X, y p eak2 = (-Sy+a)' 

If the object’s appearance changes slowly compared 
with the processing cycle of the joint transform correla- 
tor, f r _i will strongly correlate with f,, and two high- 
intensity correlation peaks can be observed at the out- 
put plane. The new location of the object at time t is 
then produced by 

Xt = (X t - 1 + Xpea k 1 ) = (X - 1 + 8x) 

yt= 1 -yypeakl + a) = O'/- 1 + $y) 

In a preferred embodiment, camera lens 112 is a 50 
mm lens used to magnify the Fourier spectrum to about 
5 to 10 lines/mm. A small circular opaque dot with a 
blurred edge is inserted at the Fourier plane to block the 
D. C. light from camera 114 which would otherwise 
cause multiple reflections and scattering at the surface 
of camera 114. 

The adaptive correlation method as described above 
requires the location of the object be initialized in the 
first frame. This is done by using the system with a 
prestored reference image located at a fixed position on 
LCTV 102. 


ft (x - *,_i - 8x,y - y t -\ - 8y + a) 2 

where la is the height of the display unit, t and t — 1 are 
the current and previous frames, and (x, y) is the rela- 55 
tive translation of the object from the (t— l)th to the t th 
frame. The complex light field at the frequency plane of 
Fourier Transform lens 110 may be expressed as, 

7?>,v) = Ft— i («,v)exp{-/27r[ux r _i + v (y[ t - 1 + d) 2 ]} + 60 

Ft (u,v)exp{— /2ir[u(Xf_ i + fix) + v (y,_ j + 8y - a) 2 ]} 

The power spectrum is magnified by lens 112 and 
recorded by TV camera 114 (preferably a Sony CCD 65 
camera) and then applied to computer 108, where it is 
grabbed and reapplied to LCTV 102. The power spec- 
trum is thus again Fourier transformed. The complex 


An object, such as vehicle V, may have distortion 
variations due to variations in size, rotation orientation, 
and perspective. Therefore, a hierarchy search of the 
object may be needed. To speed the searching process, 
distortion invariant filters such as cicular harmonic 
expansion filters or synthetic discriminant function fil- 
ters can be employed. 

The hybrid system of FIG. 2 is controlled by a C 
language computer program. Computer 108 is an IBM 
AT compatible micro-computer which runs at 10 MHz 
cpu clock speed. Two video frame grabber 116, 118 are 
employed: the IVG 128 and AT 428 from Datacube, 
Inc. Such frame grabbers can digitize a full frame of 
input video signal into a 384 X512 image array. 

The video input of the AT 428 board 116 is connected 
to a Fairchild CCD TV camera 14 which is aimed at the 
object of interest V. The video output array of the AT 
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428 board 116 is applied via conduit 120 to LCTV 102. 
Camera 114 is connected to IVG 128 board 118 via 
conduit 122. Camera 114 as explained above captures 
the joint transform power spectrum during the first half 
of the processing cycle. 

The recorded spectrum is sent from IVG board 128 
to the AT board 116 before it can be displayed on the 
LCTV 102. During the second half-cycle, the correla- 
tion result is captured by camera 114 and the peak loca- 
tion is determined sequentially by scanning the image 
array for the pixel with maximum intensity. Computer 
108 produces signals representative of the change in 
position 8x, 5y of the object V and the level of bright- 
ness of the correlation peak on leads 124, 126, 128. 

Application of Joint Transform Correlator in an 
Eye-Position Compensator 

FIG. 4 illustrates a preferred application in the field 
of eye surgery of the joint transform correlator de- 
scribed above. A joint transform correlator 200 is illus- 20 
trated schematically, and, of course, may be physically 
realized as in FIG. 2. 

An eye’s retina image or fundus is displayed on a 
surgeons monitor 204 via the captured image of it by 
TV camera 206 viewing it via gimballed tracking mir- 25 
ror 208. The image path of the fundus 202 is applied via 
path 210 to mirror 208 and thence via path 212 to 
brightness adjustment mechanism 214 and then via path 
216 to two-way mirror 220 and path 218 to TV camera 
206. The fundus image is applied to monitor 204 as a 30 
stabilized or “frozen” frame via conduit 222 and is also 
applied to Joint Transform Correlator 200 via conduit 
224. It is applied on one side of the pattern to be jointly 
transformed, while subsequent images of the fundus are 
applied on the other side. The joint transform correlator 35 
produces “delta” output signals 8x, 8y representative of 
the amount of movement in the x and y direction that 
the fundus image has moved with respect to the image 
of the frozen frame. Such 8x and 8y signals are applied 
on leads 226 and 228 to an adder 230 and ultimately 40 
applied to gimballed tracking mirror 208 for bringing 
the real-time image of the fundus into correspondence 
with the frozen frame image. 

A track ball 230 is connected to monitor 204 via lead 
232 to enable the surgeon to precisely fix a curser or 45 
cross-hair onto a position of the fundus 202 at which 
laser beam from laser 234 is to be directed. Output sig- 
nals x and y from leads 236 and 238 are applied to adder 
230 where they are respectively added to the 8x and 5y 
signals on leads 226 and 228. The error signals e* and e^ 
on leads 240 and 242 are applied to drive circuitry 244. 

As a result, link 246 turns gimballed tracking mirror to 
precisely point the laser beam from laser 234 and two- 
way mirror toward the cross-trained point of fundus 
202 . 

The real-time image B of the fundus is driven into 
coincidence with the grabbed frame image A, thereby 
stabilizing the virtual position of the retina. With mod- 
em micro-computers and equipment depicted in FIG. 4, 
a correlation measurement can be performed in 4 m sec 60 
whereas the highest frequencies in nystagmic eye mo- 
tion is 150 Hz (or a period of approximately 7 m sec). 
Accordingly the surgeon’s monitor is presented with a 
stabilized image of the eye’s fundus. 

The brightness adjustment focus mechanism 214 re- 65 
ceives brightness signal on lead 250 from joint trans- 
form correlator 250. The level of such signal, which 
represents the degree of correlation between the real- 
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time image B and the frozen frame image A, adjusts the 
focus and accordingly the spread of the laser beam as it 
is applied to the fundus. The better the correlation be- 
tween the frozen frame image A and the real-time image 
5 B, the sharper the focus of the laser beam applied to the 
retina. The tracking system is thus able to compensate 
for involuntary changes in focus of the patient’s eye and 
thus minimize the size of the spot the laser strikes on the 
retina. Loss of correlation spot brightness below a pre- 
10 determined threshold may be used to prevent the laser 
beam from being transmitted to the eye and may be used 
to signal the surgeon that a new master or frozen frame 
of the retina is required before further processing can 
proceed. 

The dynamic position of the correlation spot as mea- 
sured by signals e x , e y to drive circuitry 244 may be used 
to inhibit the operation of surgical laser 234. If the eye- 
ball twitches out of position, the joint transform correla- 
tor 200 can sense such condition faster than a surgeon 
and can inhibit operation to laser 234 if signals e*, e^are 
greater than a predetermined threshold value. Drive 
circuitry 244 includes threshold circuitry for comparing 
signals e* and t y against predetermined threshold values. 
Such feature of the apparatus of FIG. 4 is advantageous 
in that a surgeon is enabled to work closer to the retina’s 
fovea with the knowledge that the apparatus will inhibit 
the laser’s firing if the eye movement has been so fast 
and so large that the system has not been able to com- 
pensate for it at the moment the laser would otherwise 
fire. 

Various modifications and alterations in the described 
methods and apparatus will be apparent to those skilled 
in the art of the foregoing description which does not 
depart from the spirit of the invention. 

Eye surgery is only one specific example of the track- 
ing technique invention disclosed above. Another appli- 
cation is to replace mechanical gyroscopes which stabi- 
lize a tape recorded video from a hand-held video cam- 
era. In such an application, the gross scene changes only 
a small amount from frame to frame. The jitter from 
frame to frame is caused principally by the motion of 
the person holding the camera. With the invention de- 
scribed above, such motion is measured and then elec- 
tronically compensated by electronic offset addressing 
during storage or by re-aiming the lens. Such apparatus 
and method eliminates the need for the mechanical 
gyroscope. 

Accordingly such applications as described are in- 
cluded in the scope of the appended claims. The ap- 
50 pended claims recite the only limitation to the present 
invention. The descriptive manner which is employed 
for setting forth the embodiments should be interpreted 
as illustrative but not limitative. 

What is claimed is: 

55 1. A method for tracking the position of an object in 

a time sequence of time-sampled images of the object 
comprising the steps of, 

displaying sequential contiguous images of said ob- 
ject in side-by-side relation on a first spatial light 
modulator to produce a first SLM image, 
illuminating said first SLM image with a coherent 
light beam to produce a first modulated beam, 
optically Fourier transforming said first modulated 
beam to produce a transformed optical image of 
said side-by-side images, 

detecting said transformed optical image to produce a 
first detected display of said transformed side-by- 
side images, 
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displaying said first detected display on a second 
spatial light modulator to produce a second SLM 
image, 

illuminating said second SLM image with a coherent 
light beam to produce a second modulated beam, 5 
optically Fourier transforming said second modu- 
lated beam to produce a correlation optical beam of 
said side-by-side images, 

detecting said correlation optical beam to produce a 
correlation image of light spots representative of 10 
the joint correlation of said two images, 
measuring the translational relationship between said 
light spots to determine the positional relationship 
of said object between said two images, and 
periodically repeating the above steps with the se- 
quence of time-frozen images being displayed in 
time sequence in side-by-side relationship on said 
first spatial light modulator. 

2. The method of claim 1 further comprising the step 2Q 
of 

measuring the brightness of said light spots of said 
correlation image to determine the degree of re- 
semblance of said two images. 

3. A method for tracking the location of a moving 2 s 
object in a time sequence of video images comprising 
the steps of, * 

displaying an image of said object of the current 
frame in side-by-side relation with an image of said 
object in a previous contiguous frame to produce a 30 
joint display of said images, 
optically Fourier transforming said joint display of 
said image to produce a joint transform power 
spectrum of the image of said joint display, 
optically Fourier transforming said joint transform 35 
power spectrum to produce a correlation function 
between said image of said current frame and said 
image of said previous frame, said correlation func- 
tion including at least one cross-correlation peak, 
and 40 

determining the location of said object in said current 
frame by updating its location in said previous 
frame with the location of said cross-correlation 
peak. 

4 . Apparatus for tracking the position of an object 45 
appearing in a sequence of contiguous time-frozen im- 
ages of the object comprising, 

a first spatial light modulator, 
means for displaying said contiguous images of said 
object in side-by-side relation on said first spatial 5 
light modulator to produce a first SLM image, 
means for illuminating said first SLM image with a 
coherent light beam to produce a first modulated 
beam, 55 

Fourier lens means for transforming said first modu- 
lated beam to produce a Fourier transformed opti- 
cal image of said side-by-side images, 
means for detecting said transformed optical image to 
produce a first detected display of said transformed 50 
side-by-side images, 
a second spatial light modulator, 
means for displaying said second detected display on 
said second spatial light modulator to produce a 
second SLM image, 65 

means for illuminating said second SLM image with a 
coherent light beam to produce a second modu- 
lated beam, 
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means for optically Fourier transforming said second 
modulated beam to produce a correlation optical 
image of said side-by-side images, and 

means for detecting said correlation optical beam to 
produce a correlation image of light spots represen- 
tative of the joint correlation of said two images, 
and 

means for measuring the position of at least one of 
said light spots as a measure of the position be- 
tween said object in said two images. 

5. Apparatus for aiming a surgical laser at a point in 
the interior of an eye comprising, 

gimballed tracking mirror means positioned near said 
eye for reflecting an optical image of the interior of 
said eye, 

surgical laser means for generating a surgical light 
beam, 

two way mirror means disposed in the path of said 
optical image of the interior of said eye and in the 
path of said surgical light beam for passing said 
optical image through said two way mirror and for 
reflecting said surgical light beam to said gimballed 
tracking mirror, 

camera means in the path of said optical image from 
said two way mirror means for generating an elec- 
tronic image signal representative of the interior of 
said eye, 

a surgeon’s TV monitor means responsive to said 
electronic image signal for displaying a stabilized 
frame image of said image of the interior of said 
eye, 

positioning means for moving a cursor to a particular 
point on said TV monitor so as to coincide with an 
aim point on said stabilized frame image of the 
interior of said eye and for producing x and y sig- 
nals representative of the x and y locations of said 
cursor, 

joint transform correlator means responsive to said 
electronic image signal representative of the inte- 
rior of said eye including, 

means for displaying said stabilized frame image of 
the interior of said eye on one side of a joint display 
and for sequentially frames of said image on an- 
other side of said joint display, 

means for sequentially optically producing a display 
of the correlation function between said side-by- 
side images, and 

means for determining the location of each sequential 
image with respect to said image of said stabilized 
frame and for producing 6x and 8y signals repre- 
sentative of the location of at least one cross-corre- 
lation peak, said 5x and 8y signals representative of 
the movement of said image with respect to said 
image of said stabilized frame, 

adder means for adding said x signal and said 8x sig- 
nal to produce an error x signal and for adding said 
y signal and said 8y signal to produce an error y 
signal, and 

drive circuitry means responsive to said error x and 
error y signals for positioning said gimballed track- 
ing mirror means so that said surgical laser beam is 
pointed to said cursor point of said stabilized frame 
image of the eye independent of motion of said 
eyeball. 

6. The apparatus of claim 5 wherein said joint trans- 
form correlator means further produces a brightness 
signal representative of the brightness of said cross-cor- 
relation peak and said apparatus further comprises, 
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dynamic adjustment means responsive to said bright- 
ness signal for controlling said surgical light beam 
as a function of the degree of correlation between 
said image of said stabilized frame of said eye and 
said real-time image of said eye. 5 
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7. The apparatus of claim 5 further comprising, 
means for inhibiting the firing of said surgical laser 
means if said error x and error y signals are greater 

than predetermined threshold values. 

* * * * * 
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